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Abstract 

We provide explicit closed form expressions for strict Lyapunov functions for time-varying discrete 
time systems. Our Lyapunov functions are expressed in terms of known nonstrict Lyapunov functions 
for the dynamics and finite sums of persistency of excitation parameters. This provides a discrete time 
analog of our previous continuous time Lyapunov function constructions. We also construct explicit 
strict Lyapunov functions for systems satisfying nonstrict discrete time analogs of the conditions from 
Matrosov's Theorem. We use our methods to build strict Lyapunov functions for time-varying hybrid 
systems that contain mixtures of continuous and discrete time evolutions. 

Key Words: Strict Lyapunov functions, discrete and hybrid time- varying systems. 

1 Introduction 

The theory of Lyapunov functions plays a fundamental role in modern nonlinear robustness analysis and 
controller design [Tl 131 l4l ITT1 1141 IT51 1131 [TBI I18| . In many applications, it is essential to have explicit closed 
form expressions for a strict Lyapunov function. This is especially the case when one wishes to design 
stabilizing feedbacks, which are often expressed in terms of the Lie derivatives of Lyapunov functions in the 
directions of the vector fields that define the system evolution. The classical converse Lyapunov function 
theorem asserts that systems that are stable in an appropriate sense also admit strict Lyapunov functions 
[5]- However, the Lyapunov functions provided by the theory are not closed form explicit expressions since 
they involve infinite sums or improper integrals or optimal control value functions and so do not lend 
themselves to applications. Moreover, whereas most of the known explicit Lyapunov function constructions 
are for time-invariant systems, it is well appreciated that time-invariant systems are often inadequate for 
engineering practice. For example, there are many applications where the dynamics cannot be stabilized by 
time-invariant feedback but can be stabilized using time- varying controllers [S1E1E21E1- Time- varying 
systems are also ubiquitous in tracking. While some methods for building Lyapunov functions for time- 
varying systems are known, general methods for constructing explicit closed form Lyapunov functions for 
time- varying discrete and hybrid systems are not available. Hybrid systems are ubiquitous in science and 
engineering |27| . Hence, the construction of explicit Lyapunov functions for time- varying systems presents 
significant challenges that are of considerable ongoing research interest. 

One recently developed and powerful approach to this problem involves constructing strict Lyapunov 
functions in terms of given nonstrict Lyapunov functions for the system; see for instance 2 , 9j 1161 118| . By a 
nonstrict Lyapunov function, we roughly mean a function that is positive definite and radially unbounded 
and that has a negative semi-definite derivative along all solutions; see Section [21 for precise definitions. 
The advantage of this strictification approach is that in many applications, a nonstrict Lyapunov function 
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is readily available through backstepping or physical considerations For continuous time systems, the 
strictification approach has been applied to rotating rigid bodies, robot manipulators, and other important 
engineering applications. This suggests the possibility of extending the strictification approach by construct- 
ing explicit closed form Lyapunov functions for discrete time time- varying systems or, more generally, hybrid 
time-varying systems containing both continuous and discrete time evolutions. The purpose of this work is 
to show that both of the extensions are indeed possible. 

In Section|2 we provide the relevant definitions of strict Lyapunov functions and the necessary formalism 
of hybrid systems, hybrid time domains, and hybrid trajectories. In Sectional we show how to construct 
explicit closed form strict Lyapunov functions for time-varying discrete time nonlinear systems in terms of 
given nonstrict Lyapunov functions. This provides a discrete time analog of |16j as well as a more explicit 
Lyapunov function construction than the known discrete time constructions that involve infinite sums of 
persistency of excitation (PE) parameters |2()j . We also build Lyapunov functions for time- varying systems 
under appropriate versions of the assumptions from Matrosov's Theorem thus providing a discrete time analog 
of the results JS| on continuous time systems satisfying the Matrosov conditions. In Section 0] we merge 
our results with the known continuous time analogs to construct explicit closed form Lyapunov functions for 
time-varying hybrid systems, under appropriate hybrid analogs of the PE or Matrosov conditions. To our 
knowledge, this provides the first general method for explicitly constructing Lyapunov functions for general 
time-varying nonlinear hybrid systems. In Sectional we prove our theorems. We provide some examples 
covered by our results in Section H3 and we close in Section with some remarks about possible extensions. 

2 Definitions, Assumptions, and Lemmas 

We let /Cqo denote the set of all continuous functions p : [0, oo) — * [0, oo) for which (i) p(0) = and (ii) p is 
strictly increasing and unbounded. Note that /Coo is closed under inverse and composition; i.e., if pi, p 2 G /Coo, 
then p7 , pi o p2 E /Coo- We let K.C denote the class of all continuous functions (3 : [0, oo) x [0, oo) — > [0, oo) 
for which (I) (3(-,t) G /Coo for each t > 0, (II) f3(s, ■) is non-increasing for each s > 0, and (III) f3(s,t) — > 
as t — > +oo for each s > 0. We let K.CC denote the set of all functions (3 : [0, oo) x [0, oo) x [0, oo) — > [0, oo) 
such that for each i > 0, the functions (s.t) i— > j3(s,t,i) and (s,t) i— > f3(s,t,t) are of class ICC. When 
we say that a function p is smooth (a.k.a. C 1 ), we mean it is continuously differentiable, written p G C . 
(For functions p defined on [0, oo), we interpret p'(0) as a one-sided derivative, and continuity of p' at as 
one-sided continuity.) 

We set Z>o = {0, 1,2,.. .}, wc let R™ denote the set of all real n-tuples, and we use | • | to denote 
the usual Euclidean norm. We say that a function 9 : R n x [0, oo) x Z>o — » R : (x,t,k) t— > Q(x,t,k) 
(which may be independent of t or k) is uniformly state-bounded and write G USB provided there exists 
p, G /Coo such that \Q(x,t, k)\ < p(\x\) for all x G R™, t > 0, and k G Z>o More generally, a vector valued 
function H : R" x [0, oo) x Z> — * R™ : (x, t, k) ^ H(x, t, k) is of class USB, written H G USB, provided 
{x, t, k) i— > \H{x, t, k)\ is of class USB. Following |13| . we also say O is uniformly proper and positive definite 
(UPPD) and write G UVW provided there are a±,a2 G /Coo such that cki(|x|) < Q(x,t, k) < a.2(\x\) for 
all x G R", t G [0, oo), and k G Z>o- We say is (u>±, ui2 ^-periodic provided uj\ G [0, oo) and u>2 G Z>o satisfy 

Q(x, t - wi, k - uj 2 ) = 0(x, t, k) \/{x, t, k) G R n x [0, oo) x Z> . 

When is independent of t (resp., k), we define ^-periodicity (resp., wi-periodicity) analogously. A 
continuous function defined on a subset of Euclidean space that includes and valued in (— oo, 0] is negative 
semi-definite provided it is zero at zero. A continuous function a defined on a subset of Euclidean space and 
valued in [0, oo) is positive definite provided a is zero only at zero in which case we also write a G VT>. 
We study the stability properties of the discrete time fully nonlinear time- varying system 

Xfc+i = F(x k ,k) (1) 

where we always assume F G USB. We also study continuous time time-varying systems 

x = G{x,t) (2) 

where G G USB is locally Lipschitz. We always assume (j2J is forward complete, meaning for each x G R ra and 
t > 0, there is a unique solution t cf>(t, t a , x Q ) for @ defined on [t D , oo) that satisfies 4>(t , t Q , x Q ) = x a . We 
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interpret the solutions of (J2J in the generalized Lebesgue almost all (a. a.) sense. We also use fc h- > 0(fc, fc Q , x a ) 
to denote the discrete time solution of Q satisfying 4>(k ,k ,x ) = x whenever this would not lead to 
confusion. Given a function V : W 1 x [0, oo) x Z>o — > M : (x, t, fc) i— » V(x, t, k), we set 

dV dV 

A k V{x,t,k) := V(F(x,k),t,k + 1) - V(x,t,k), VV(x,t,k) := — (x,t,k) + -^(x,t, k)G(x,t) 

assuming (x, t) i— > F(ic, i, fc) is also smooth for each fc S Z>o in the definition of DV. In our analysis of (JTJ, V 
will generally not depend on i but we need to allow its dependence on t in our discussion of hybrid systems. 

Definition 1 (a) Let V : W 1 x Z>o — > R 6e o/ class UVVD. We call V a (strict) Lyapunov function for 
0) provided there exists as G VD such that: 

A k V(x,k) < -a 3 (\x\) Vx G M n & fc G Z> . (3) 

(b) We say that £7J) is globally asymptotically stable (GAS) provided there exists [3 G ICC such that for all 
x Q G W 1 and k a £ Z>o, we have \<f>(k, k 0l x Q )\ < (3(\x \, k — k D ) for all k > k a . 

The corresponding Lyapunov function and GAS definitions for (J2J are obtained from Dcfinition^by replacing 
k with t, Z> with [0, oo), and AkV with DV. Notice that we do not require 03 to be of class /Coo. For 
the special case where as G /Coo, the existence of a discrete time Lyapunov function V is known to imply 
that QJ is GAS since then AkV(x, k) < — a(V(x, k)) everywhere with a := a% o a^ 1 G /Coo and 02 as in the 
UVVD condition on V 21. Theorem 8]. Furthermore, by replacing the function CK3(|x|) in © by the smaller 
function Q(V{x, k)) := min{of3(s) : a^ 1 (T^(a;, fc)) < s < a^ 1 (V(x 1 fc))}, we are in a situation where Lemma 
El below applies and straightforwardly implies that one can construct a Lyapunov function satisfying © 
with a new function a 3 of class /Coo. Combining this fact with the stability result from |21j . we get: 

Lemma 2 If 0) admits a strict Lyapunov function, then it is GAS. 

We also use the following persistency of excitation (PE) notions from [131 12U) : 

Definition 3 (a) We say that a bounded function p : Z>o — > [0, 00) is of discrete PE type with parameters 
I and 6 and write p G Vdis{l, 5) provided I G Z>o and S > are such that 

k 

P(i) > S Vfc G Z> . (4) 

i— k — I 

(b) We say that a bounded continuous function q : [0, 00) — > [0, 00) is of continuous PE type with parameters 
r and e and write q G V c t a {T, e) provided r > and e > are such that 

t 

q(r)dr > e Vt > 0. (5) 

I t-T 

(c) We set V dis = U^di^, 6) : I G Z> ,6 > 0} and T cts - U{^cts(r,e) : r > 0,e > 0}. 

Elements of 'Pdis and T^cts are called PE parameters and arise in a variety of contexts, e.g., q(t) — sin 2 (t) 
as well as cases where q can be null on intervals of arbitrarily large length |13j. The following lemma 
follows from a simple change of variables, a Fubini Theorem argument (as was used in |13p. and the formula 
1 + 2 + . . . + to = m(m + 1) /2: 

Lemma 4 Let I G Z>o, let t,e,S > 0, and let p G Vdis(h^) an d 1 G 'P c ts(T,s) be bounded above by p and q 
respectively. Define the functions S : Z>o — > [0, 00) and R : [0, 00) — > [0, 00) 6j/ 



)dvdz. (6) 



s=k—l j 



Then S(k) < p(l + I) 2 and R(t) < r 2 q/2 ZioZd /or all k G Z>o and t > 0. J/p is l-periodic, then so is S. If q 
is t -periodic, then so is R. 
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We next recall the hybrid system tools developed in [HI G], generalized to time- varying systems. For 
simplicity, we only consider singleton valued dynamics although our results carry through in the more 
general setting of difference and differential inclusions. Given sets C,D C R" and F and G satisfying the 
assumptions above, the corresponding hybrid dynamical system is defined to be the formal object 

_ J x = G(x,t), x G C 
\ x k +i = F(x k ,k), x k £ D 

A compact hybrid time domain is a subset E C [0, oo) x Z>o of the form U^J^ 1 ([^fe, ife+i] x {fc}) for some finite 
sequence < t a < t\ < . . . < tx- A hybrid time domain is a set E C [0, oo) x Z>o with the property that 
for all (T, K) £ E 1 , the intersection _E n ([0, T] x {0, 1, . . . , K}) is a compact hybrid time domain. A hybrid 
arc is a function x(t, k) defined on a hybrid time domain dom(a;) such that t i— > fc) is locally absolutely 
continuous for each k. A hybrid trajectory of is a hybrid arc x(t, k) that satisfies the following: 

(S±) For all k £ Z>o and a. a. £ such that (t, fc) € dom(ar), we have x(t, k) £ C and -§^x(t, k) — G(x(t, k), t). 

(S2) For all (t, fe) £ dom(a;) such that (t, fc + 1) £ dom(a;), we have x(t, k) £ D and fc+ 1) = F(x(t, k), k). 

Notice that £ is a hybrid time domain provided it is a finite or infinite union of sets of the form 
[tfc, ife+i] x {k} with {tk} nondecreasing in [0, 00), with a possible additional 'last' set having the form 
[tk,T) x {k} with T finite or infinite. To keep our notation simple, we use Ufe 6 j([tfe, tk+i] x {k}) to denote 
a generic hybrid time domain with the understanding that (i) either J — Z>o or J is a finite set of the form 
{0, 1, 2, . . . , jmax} and (ii) [tfc, tfc+i] may mean [tk, tk+i) if J is finite and k = j max . Notice that continuous 
time solutions of J5J in C and discrete time solutions of (JTJ in D starting with k = correspond to hybrid 
trajectories of J7J) that have no switchings between the discrete and continuous evolutions. 

Definition 5 (a) Let V £ UVW be C 1 in x and t. We call V a (strict) Lyapunov function for H provided 
there exists 0:3 £ VT> such that the following hold for all t > and k £ Z>o : 

A k V(x,t,k) < -a 3 (|ar|) Vx e D: VV(x,t,k) < -a 3 (\x\) Vx £ C. (8) 

//, in addition, there is a constant r > such that 

V(F(x,k),t,k + l) < e~ r V(x,t,k) VxeD; VV(x,t,k) < -rV(x,t,k) Vx £ C, (9) 

then we call V an exponential decay Lyapunov function for TL. (b) We call TL globally asymptotically stable 
(GAS) provided there exists [3 £ K.CC such that: For each trajectory x(t, k) of TL defined on any hybrid time 
domain Ukej([tk, tk+i] x {k}), we have \x(t, k)\ < j3(\x(t , 0)|, fc, t — tk) for all k £ J and all t £ [tk, ifc+i] • 

Lemma QlfTL admits a Lyapunov function, then it is GAS. 

To prove this lemma, first note that since a 3 in (jSJ) is independent of k, standard arguments (e.g. those 
in |23 | applied with a(x) := CK3 )) provide (3i £ ICC such that for each hybrid trajectory x(t,j) defined on 
a hybrid time domain Ufe 6 j([ifc, tk+i] X {k}) and satisfying any initial condition x(t a , 0) = x a , we have 

\x(t,k)\ < Pi(\x(t k ,k)\,t~t k ) Vfc£j, te[tk,t k+ i}. (10) 

Similarly, since 013 in © is independent of t, and since we can assume as above that a 3 £ /Coo, the argument 
from (21 Theorem 8] provides (3% £ ICC such that 

\x(t k ,k)\ < (3 2 (\x \,k) Vfc £ J. (11) 

In fact, can be constructed using the decay conditions from © as follows. First note that by arguing as 
in the proof of Lemma above and replacing V with k o V for a suitable function k £ /Coo in the discrete 
decay condition without relabeling, we can find 7 £ /Coo such that AkV(x, t, k) < — ^(V(x, t, k)) when x G D; 
see Lemma IT5l for the construction of K. Since t ^ V(x(t, k),t, k) decays on (tk,tk+i) for each k, we get 
V(x(t k + 2 ,k+l),t k+ 2,k+l) < V(x(t k+1 ,k + \),t k +i,k + \) = V(F(x(t k+ i,k),k),t k+ i,k + l) so 

V(x(t k+ 2,k + l),t k+2 ,k + 1) - V(x(t k +i,k),t k +i,k) < A k V(x(t k +i,k),t k +i,k) 

< -~f(V(x(tk+i,k),t k+ i,k)) 
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everywhere. Applying Theorem 8] to the function fc i— > V(x(tk+i, k), tk+i, k) and recalling that V is 
uniformly proper and positive definite gives /3 2 E /C£ (not depending on the choice of the trajectory) such 
that \x(tk+i,k)\ < PzQxfti, 0)|, fc) for all fc. Choosing a 1: a 2 E /Coo such that ai(|x|) < V(x, fc) < a 2 (|x|) 
everywhere, the discrete time decay condition in (JSj gives 

\x(t k +i,k)\ > a^ 1 oV(x(t k +i,k),tk+i,k) > a^ 1 oV(x(tk+i,k+ l),t k+1 ,k + 1) > a^ 1 o ai (\x(t k+1 , k + 1)|) 

for all fc E J. Similarly, the continuous time decay condition in (JHJ gives 

|x(*i,0)| < af 1 oF(x(t 1) 0),ti,0) < o^ 1 o V(x(i o ,0),i o ,0) < a^ 1 o a 2 (|x |). 

We can therefore satisfy by taking /3 2 (s,fc) := a^f 1 o a 2 o /^(a^ 1 o a 2 (s),fc) + s/(fc + 1), where the 
additional term s/(fc + 1) is used to account for the case fc = 0. Combining H1U|) - (|11|) shows we can satisfy 
the requirements of Lemma |H] using (3(s,t, fc) = /3i(/3 2 (s, k),t). 

3 Statement of Results on Discrete-Time Systems 

3.1 Strictifying Persistence of Excitation (PE) Decay Estimates 

We begin by constructing explicit closed form Lyapunov functions for discrete time systems in terms of 
nonstrict Lyapunov functions and appropriate PE parameters p E Vdis- For an alternative construction, 
involving infinite sums of PE parameter values, see [23! • We prove the following in Section 

Theorem 7 Let I E Z> , 5 > 0, p E V d i S {l,S), V E UVW, and E W satisfy 

A k V(x,k) < -p(k + l)Q(V(x,k)) VxER"&fcEZ> . (12) 

Then one can construct k, 7 E /Coo such that 

U(x,k) := K ( V (x,k)) + &^ Yl EpC7) (13) 

^ ' s=k-l j=s 

is a strict Lyapunov function for £7J), so £7J) is GAS. If p and V are also both l-periodic in fc, then so is U. 

Remark 8 A key feature in \l'0j> is that the PE condition on p allows p{k + 1) = for some values of k in 
which case we could have A^V(x, fc) = 0. An additional novel feature of Theorem^is that we do not require 
the gain function in to be of class /Coo ■ This properness of the gain function was required in USl \2(Jf . 
Our proof of Theorem^ will show that we can take k(s) = s if E /Coo- 

3.2 Lyapunov Function Constructions Under Matrosov Conditions 

Recall the definitions of UVW and USB from Section We explicitly construct a Lyapunov function for 
discrete time systems Q satisfying the following analog of the Matrosov Theorem conditions from ^Hl : 

Assumption 9 There exist V x : R™ x Z> -» [0, 00) of class UVW, V 2 : M" x Z> — » R of class USB, a 
function (f>2 E /Coo, nonnegative functions N\,N% E USB, a function \ '■ R n x [0, 00) x Z>o — > R, a positive 
increasing function 4>\, a positive definite function W , and p E Vdis such that 

A k V!{x,k) < -AMx,fc), 

A k V 2 (x,k) < -N 2 (x,k) +x(x,Ax(x,fc),fc), 

|x(x, Ai(x,fc),fc)| < 0i(|x|)0 2 (iVi(x,fc)), and Ai(x, fc) + A 2 (x, fc) > p(k + l)W(x) 
hold for all x E R™ and k E Z>o- 

Notice that we allow V 2 to take both positive and negative values. In Section we prove: 

Theorem 10 If 0) satisfies Assumption^ then one can construct an explicit strict Lyapunov function for 
In particular, 0) is GAS. 
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4 Statement of Results on Hybrid Systems 



4.1 Hybrid Persistency of Excitation Estimates 

We next extend Theoremdto hybrid systems. To keep the exposition simple, we assume the gain functions 
in ljl2[) and its continuous analog are 0(s) = s, but the extension to general positive definite can be 
done using similar arguments. We prove the following in Section [SJ 

Theorem 11 Let V G UVVD be C 1 in x and t. Consider the hybrid system TL in Q), and let 6, e, t > 
and I G Z>o be given. Assume there exist r G Vdis(h 5) an d Q £ ^ctsO~j e) such that 



V(F(x,k),t,k + l) < e- r(k+1) V{x,t,k) VxeD; 
hold for all t > and k G Z>o- Then 

k k 



DV(x,t,k) < -q(t)V(x,t,k) VxGC (14) 



V\x,t,k) = 



4(1 



->-(i) 



9(1/) dz/ dz 



V(x,t,k) 



(15) 



is an exponential decay Lyapunov function for TL which is therefore GAS. If in addition V is (r, I) -periodic 
and r and q are l-periodic and t -periodic respectively, then V" is also (r, I) -periodic. 

Remark 12 The preceding theorem covers continuous dynamics (by taking D — and C = K n with the 
understanding that the term involving the double sum in V" is not present) and discrete dynamics (by taking 
C = and D = R" in which case the term involving the double integral in V$ is not present). See '61 for an 
alternative, nonexplicit construction of a Lyapunov function for time-invariant hybrid systems. 



4.2 Hybrid Systems Satisfying Matrosov Conditions 

We next extend Theorem^] to hybrid systems that satisfy the following analog of Assumption [5] 

Assumption 13 There exist Vi G UVVD and V2 G USB that are C 1 in (x,t), nonnegative N\,N2 G USB, 
a function \ '■ R" x [0, oo) 2 x Z>o — ► K, a positive increasing <pi, and a positive definite function W , p G Vd- ls , 
4>2 G /Coo ) and q G V c ts such that 

1. For allx G D, we have AfcVi(x, t, k) < -Nx(x,t, k), A k V 2 (x, t, k) < -N 2 (x,t, k)+x(x, N x (x, t, k), t, k), 
and Ni(x, t, k) + N 2 (x, t, k) > p(k + l)W(x). 

2. For all x G C, we have DVi(x,t,k) < -Ni(x,t,k), DV 2 {x,t,k) < -N 2 (x,t,k) + \{x, Ni(x, t, k), t, k), 
and Ni(x,t,k) +N 2 (x,t,k) > q(t)W(x). 

3. For all x G R", we have \x(x,Ni(x,t, k),t, k)\ < 4>i(\x\)<j)2(Ni(x, t, k)). 

hold for all t > and k G Z>o- 

Assumption 1131 simply means the discrete and continuous parts of TL satisfy the appropriate discrete and 
continuous Matrosov conditions. It reduces to Assumption for discrete systems when C = and D = R ra 
in which case its condition 2. holds vacuously. Notice that we again do not require V2 to be nonnegative. In 
Sectional we prove: 

Theorem 14 If If. satisfies A ssummtion 1 1 S\ then one can construct an explicit closed form strict Lyapunov 
function for TL. In particular, TL is GAS. 



5 Proofs of Theorems 

5.1 Results on Discrete Systems 
5.1.1 Proof of Theorem 

By minorizing G VD without relabeling as in |17| . we assume in the sequel that G C 1 is nondecreasing 
on [0, 1] and nonincreasing on [1, 00). The next technical lemma allows us to assume that G /Coo in l|12ll : 
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Lemma 15 Let G VT> be as above and p G Pdis- Define fi : [0, oo) — * [1, oo), k, and x by 



K(r) 



fi(z)dz, x( r ) : = 0(2r)/i(r), and /x(r) 



l + 4r 2 , 0<r<l/2 
46(l)r 



(16) 



Let !/ £ WPPP satis/?/ A fc ^(x, k) < -p(k + l)0{v(x, kj) for all x G R n and k G Z> . Then Ke^nC 1 , 
X G ^Coo, and V :— n(i>) G IAWT> satisfies 



A k V{x, fc) < -p{k + lh(V{x, k)) Vx G R" & k e Z> , 
where 7 G /Coo is defined by 'y(s) := x( K_1 ( s )/2)- 



(17) 



To prove Lemma fix x G R™ and fc G Z>o and apply the Fundamental Theorem of Calculus to s 
.F(s) := k (sv(F(x, k),k + 1) + (1 - s)v(x, k))to write A k V(x, k) = - T{0) = :F'(s) ds and so also 



A fe F(x,fc) = 



k' (sv(F(x, k), k + 1) + (1 - s)i/(x, fc)) ds 



[z/(F(a;,A;),fc + l) - v(x,k)] 



< -p(k + l) 

< -p(k+l) 

< -p(k+l) 



k'{sv(F(x 1 k),k + 1) + (1 - s)v(x, k))ds 



@(v{x,k)) 



k'((1 — s)v(x, k))ds 
f 1/2 /I \ 

V2 7 



9(i/(x,A;)) 



6(^(x,fc)) = -p(k+l)n[-u(x,k))Q(v(x,k)) 



where the first inequality holds because k is nondecreasing and the other inequalities used the fact that k' 
is nondecreasing. The lemma now follows from our choices of 7 and \- 

We can therefore assume that V satisfies (II 7|) with 7 G /Coo, possibly by replacing V with k(V) for 
k G /Coo defined in Ijltifl . Defining S(k) as in © and defining £/ by with k(s) = s therefore gives 

A k U(x, k) = V{F(x, k),k + l)+ S }* + ^ l(V{F(x, k), k + 1)) - V(x, k) - - f} h \ 1 (V{x, k)) 



A k V{x,k) + 



1 



4(1 + 1) 

-S(k + l)A k ( 1 oV)(x 1 k) + 



1 



4(2 + 1) v ' * w /v ' y 4(2 + 1) 
< A k V(x, k) + —L— 1 {y{ Xl k)) [S(k + 1) - S(k)} , 



4(1 + 1) 
1 (V(x,k))[S(k + l)-S(k)} 



4(1 + 1) 

where the last inequality holds because 7 is increasing, so A&(7 o V)(x, k) < 0. Note that 

k k fe 

E Z>tf) + (' + w + !) - E 

s— — I j—s s—k—l j — s 

k k k k k 

E Z>0')- E p(i) + a+i)p(*+i)- E EpW 



(18) 



S(fc + 1) - 5(jfe) 



(19) 



s=k—l j=s 
k 

- E p(i) + + i)p(fc + i). 



s=k-l j=s 



Substituting JT^J into 1(15)1 gives 
A fe [/(x,fc) < A k V(x,k) + 



4(1 



i^7(y(x,fe)) ^ + i)p( fc +i)- £ 



< A^^+^+^^-^-y e Ki) < - 



(20) 



4(1+1) 



j=k-i 



4(1 + 1) 



7(^(1,*)), 
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where the last inequality follows from the PE property of p and (jl7(l . This, the fact that V £ UWT), and 
the global boundedness of S(k) from Lemma 01 shows that U is a Lyapunov function for (JJJ. Therefore, QJ 
is GAS, by Lemma[21 The assertion in the theorem about periodicity follows from Lemma0]and the formula 
for U, so this proves our theorem. 

5.1.2 Proof of Theorem [Tol 

Let V3 = V\ + V2, and let a.1,012 £ /Coo satisfy the UPPD requirements for V\. In the rest of the proof, 
all inequalities should be interpreted as holding globally unless otherwise indicated. We also leave out the 
argument (x, k) of some of our USB functions when this would not lead to confusion. It follows from 
Assumption that we can determine a positive definite function A such that 

A k V 3 {x,k) < -p(k + l)W(x) + MM)MNi{x,k)) < -pik + lMVifakfi + MWMNtfak)) ( 21 ) 

e.g. A(s) = jnin{W(x) : x £ K™,ai(|a;|) < s < ce2(\x\)} (which is positive definite because W £ VT>). By 
minorizing A as necessary as in ^21, we can assume it is C 1 , nondecreasing on [0, 1/2] and nonincreasing 
on [1/2, 00). The proof of Lemma Il5l above with 0(r) := A(r/2) provides an increasing continuous function 
ki : [0,oo) — > [l,oo) such that Ai(s) := fci(s)A(s) is of class /Coo. Let V4 = ki{V\)V 3 . Then gives 

A k V^x,k) = [k 1 (V 1 (F(x,k),k + l))-k 1 (V 1 {x,k))]V 3 {F(x,k),k + l) 
+h(V 1 (x, k)) [V 3 (F(x, k), k + 1) — V 3 (x, k)} 

(22) 

< [k 1 (V 1 (F(x,k),k+ 1)) - k 1 (V 1 {x,k))]V 3 (F(x,k),k + l) 

-hiVxix, k))p(k + l)A(^(a;, k)) + k^V^x, k))M\x\)MNi(x, k)) . 

Since F, V 3 £ USB and V\ £ UWT), we get continuous increasing positive functions Y and A2 such that 

A k V^x,k) < [-A k V 1 (x,k)]T(V 1 (x,k))-p(k + l)A 1 (V 1 (x,k))+A 2 (V 1 (x,k))MNi(x,k)) (23) 

e.g. by first finding an increasing positive function a such that fci(r)| < a(r). Define k 2 £ /Coo by k 2 (s) = 
sT(s). Since k2(s)/s is increasing, we have fe(&) — > (6 — a )T(&) when b > a > (since (fe(&) — 

fc2(a))(6 — a) -1 > k 2 {b)b~ 1 when 6 > a > 0). Hence by choosing a = Vi(-F(x, fc), fe + 1) and b — Vx(x, k), 
we get Ak(k 2 o V%)(x, k) < A k V%(x, fe)r(Vi(a;, k)) everywhere. Therefore, by adding a /Coo function to &2 as 
necessary, we can assume V5 :— V4 + k 2 (Vi) G UVVD and satisfies 

A k V 5 (x,k) < -p(k + l)A 1 (V 1 (x 1 k))+A 2 (V 1 (x,k))MNi(x,k)). (24) 

Arguing as in the proof of Theorem [3 except with 7 replaced by Ai provides Ve £ UWT) such that 

A k V 6 (x,k) < -^—A 1 (V 1 (x,k)) + A2(V 1 (x,k))<l>2(Ni(x,k)). (25) 
By arguing as in |17l Section IV. A], we can select k 3 £ C 1 fl W so that \k' 3 (s)\ < 1 for all s > and 

4 »< r » s «' Ui 1)1 + £<,) ) I+55T' *fe«)A 2 «))A 2 W) < sjf^A.oy (26) 

everywhere. Choose /i_F,a6 £ /Coo such that Ve(x,k) < ae(\x\) and \F(x,k)\ < /xf(|x|) everywhere. Arguing 
as above (with P replaced by o o a^ 1 ) and recalling that A k Vi(x, k) < provides &4 £ /Coo such that 

Ak{k4°Vi)(x,k) < a 6 o up o a^ 1 oVi(x,k)A k Vi(x,k) < a 6 ((i F (\x\)) A k Vi(x , k) 

everywhere. Since \k 3 (s)| < 1 for all s > 0, we have 

[A k (k 3 oV 1 )(x,k)]V 6 (F(x,k),k + l) < [-A k V 1 (x,k)]V 6 (F(x,k),k + l) < -a^p^AMx.k) 
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everywhere. It follows that V7 := fc 3 (Vi)V6 + fci(Vi) G UWT) satisfies 

A k V 7 (x, k) = [A k (k 3 o Vx)(x, k)]V 6 (F(x, k),k + 1) + hiVyix, k))A k V 6 (x, k) + A fc (fc 4 ° Vi)(a;, fc) 
< -4(7TT) fc 3(^i)Ai(yi) + k 3 (V 1 )A 2 (V 1 )MNi(x 1 k)) . 

Next note that for all functions fi G /Coo, 
(5 



(27) 



A k V 7 < 



4(1 + 1) 



fc 3 (V r 1 )A 1 (t/ 1 ) + /x (fc 3 (^i)A 2 (V 1 )) fc 3 (F 1 )A 2 (t/ 1 ) + //-^^(^(x, k)))4> 2 (Ni(x, k)). (28) 



(The fact that a& < //(a)a + /i 1 (fo)fo for all a, 6 > follows by separately considering the cases where /x(a) > b 
and ^ _1 (6) > a.) Choosing /i = fa in (|28|l gives 

A fc V 7 < -anTIT W)Ax(Vi) + fa (k 3 (V 1 )A 2 (V 1 )) fc 3 (Vi)A 2 (Vi) + 7Vi(x, /c)^(JVi) 

7 , ,„w . „ ™s (29) 



< 



MVi)MVi)+N 1 (x,k)tl>2{Ni) (by 



8(1+1) 

Therefore, since Ni G USB and ^2 G /Coo, a suitable function </> 3 G /Coo gives 

5 



8(2 + 1) 



fcs(Vi)Ai(7i)+JVi(a:,A!)0a(^)- 



(30) 



Arguing as in the construction of &2 above (but with T replaced by fa) provides &5 G /Coc such that 
A*(*6oVi)(i,fc) < A fc Vi(a:,fc)03(ViOE>*)) < —Ni(x, k)fa(Vx(x, A;)). Hence, Vg := + Wi) G UWD 
satisfies 

A fe y 8 (a;,fc) < -- 7r _ T fc 3 (V 1 (a;,fc))Ai(V 1 (a:,fc)) < -a 3 (|ar|), (31) 



8(2 + 1) 



where 



a3(s) 



min{fc 3 (u)Ai(u) : «i(s) < u < a>2(s)}. 



8(1 + 1) 

Since a 3 G Vg satisfies the requirements of the theorem. This and Lemma proves the theorem. 

5.2 Results for Hybrid Systems 
5.2.1 Proof of Theorem [TT] 

For each k G Z>o, let Kts^j^, k) denote the continuous-time strictification of V obtained in ^21 f° r the 
nonstrictness parameter q G V c ts- Thus, 



V c ts(x,t, k) 



q(y) dv dz 



V(x,t,k) . 



The results from show that W c t s (x,t, k) < — (e / T)V cts (x , t , k) for all x G C, t > 0, and k G Z> . We 
next rewrite the first decay condition in l|14|) as 

V(F(x,k),t,k + l)-V(x,t,k) < -p(k + l)V(x,t,k), Vx g D, t g [0, 00), k G Z> (32) 

where k i-» p(fc) := 1 — e~ r ( fc ) is again of PE type. For each t > 0, let V d i s (x,t, k) be the strictification 

k k 



Vdis(a;,t,fe) := 



^ ' s=k-l j=s 



V(x,t,k) 



of V from Theorem^! The proof of Theorem shows we can take k(s) = 7(5) = s, and therefore also 

S 



A k V dis (x,t,k) = V dis (F(x,k),t,k + l) - V dis (x,t,k) < 



4(2 + 1) 



V dis (x,t,k) Vi G [0,oo), fc G Z> 
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for all x G D. By enlarging I from the PE assumption as necessary, we can assume 8 < I. It follows that the 
discrete decay condition in fTljl holds with V replaced by Vdis and with the constant 

Since T>V < on C and A^V < on D, we have Wdi s < on C and AkV c t s < on D. The uniform 
boundedness of S(k) and J. J q(v) dv dz from Lemma 0] provides constants r Cl rd > such that 

V cts {x,t,k) < r c Vd is (x,i, fc) < r d V cts {x,t,k) 

everywhere. One therefore easily checks that V*(x,t, k) := V c t s (x,t, k) + Vdi S {x,t, k) as given by (jT5|) is an 
exponential decay Lyapunov function for the hybrid dynamic TL. The periodicity assertion follows as before 
from Lemma 01 so the result follows from Lemma |SJ 

5.2.2 Proof of Theorem H31 

For each t > we apply the first part of the proof of Theorem 1101 to the functions (x, k) i— > Vi(x, t, fc) and 
(x, k) i— > V~2(x, t, k) to get V5 that satisfies 

A k V 5 (x,t,k) < -p(fc+l)Ai(Vi(x,t,fe))+A2(Vi(x s t ) fc))^ 2 (JV l (a; ) t,*)) Vx G L>, * > 0, fc G Z> . (33) 

This can be done with Ai G C 1 and A 2 independent of t. For each k G Z> , we next apply the continuous 
time analog of the preceding argument (which is almost exactly the same except with A^Vi replaced by DVi 
for i = 1,2,. ..,5, as discussed in the appendix below) to get a continuous version V£ ts of V5 that satisfies 

W 5 cts (x,i,fc) < -q(t)k 1 {V 1 (x,t,k))+ k 2 {V 1 {x,t 1 k))(t)2(N 1 (x,t,k)) Vx G C,t > 0,fc G Z> . (34) 

In fact, by enlarging k 2 as necessary (e.g., by enlarging T in the discrete version of the proof), we can assume 
V 5 cts and V5 have the same formula. Applying the strictification method from Theorem [7| to V5 produces 

V 6 dis (x, t, k) := V 5 (x, t, k) + —L--S(k)Ai(y 6 (x, t, k)) 

that satisfies (|25|l with Vg replaced by Vg 8 and with V\ and ATi now also depending on t. Similarly, we apply 
the continuous time strictification from J3| (as in the proof of Theorem II 1|) to V 5 cts to get 



V 6 cts (x,t,k) :=V 5 cts (x,t,k) + - 



q(y) dv dz 



Ai{V£ ts (x, t, k)) 



that satisfies VV§ ts (x, t, k) < -A x (Vi(x, t, k)) + A 2 (Vi(x, t, k)) <f> 2 (Ni(x, t, k)) when x G C, possibly by 
reducing Ai and increasing A 2 G /Coo without relabeling. Setting Vq = Vg cts + V 6 dls , and assuming without 
loss of generality that 1 > 5/{A(l + 1)} (by enlarging / without relabeling as before), it follows from the fact 
that V 5 cts and V5 have the same formula that we can enlarge A 2 sufficiently so that 

A k V 6 (x,t,k) < - - Ai (Vl(x, t, k)) + A 2 {Vx(x, t, k)) MNi(x, t, k)) Vx G D (35) 
VV 6 (x,t,k) < - + Ai (Vi(x, t, k)) + A 2 f, fc)) MNi(x, t, k)) VxeC (36) 

hold for alH > and k G Z> . (This can be seen by bounding \A[ | on the relevant intervals and recalling that 
F,G G and V 1 G UVVV. In particular, to get (HJ), we write A fc (A x o V 5 )(x, t, k) = A' x (77^(^(2;, fc), i, fc+ 
1) + (1 — 77)Vs(x, t, fc))AfcVr;(x, <, fc) for r/ G [0,1] depending on x, £, and fc and use the fact that A^ > 
everywhere.) We next follow the reminder of the proof of Theorem ^| applied to Vq for each t > to get a 
function Vg(x,t, fc) satisfying the conclusion of the proof when x G D. We also apply the continuous time 
analog of that part of the proof to V§ for each k (with A^Vi replaced by T>Vi for all i as before, similarly to 
the argument done in the appendix below) to get V£ ts satisfying 



W 8 cts (x,i,fc) < -a(|x|), Vx G C,t > 0,fc G Z> 
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for a suitable a G VT>. By enlarging k^ , fcg G /Coo and reducing k 3 G VV in the continuous and discrete 
versions of the proof, we can assume they are the same in both versions, so V$ ts and V^ dls have the same 
expression. Hence, we can satisfy the requirements of the theorem with their common value. Combined with 
the result of Lemma |SJ this proves the theorem. 



6 Examples 

One class of systems covered by our discrete time results is as follows. Assume Q is GAS and that a 
strict Lyapunov function V for the system is available. This provides a\, ui G /Coo and a 3 G W such that 
A k V(x, k) < — a 3 (|x|) and ai(|x|) < V(x, k) < «2(M) everywhere. Assume now that the system is acted on 
by a PE term p £ Vdis that freezes the dynamics for certain times. The new system becomes 

x k+1 = [l-p(k+l)}x k +p(k+l)F(x k ,k). (37) 

Thus the new dynamic F p (x, k) := [1 — p(k + l)]x + p(k + l)F(x, k) fixes the state when p(k + 1) = 0. 
By separately considering the cases p(k + 1) = and p(k + 1) = 1, one checks that if p(k) G {0, 1} for 
all k, then V(F p (x,k),k + 1) - V(x,k) < -p(k + l)a 3 (|a;|) < -p(k + l)<d(V(x, k)) everywhere, where 
0(s) = min{o!3(p) : (s) < p < a^ 1 (s)}. Since 6 G W, V satisfies the PE decay condition from 
Theorem for the new dynamic F p . More generally, assume p(k) G [0,1] for all k. Assume also that 
V{x,k) is a Lyapunov function for Q that is independent of k and convex in x. Choose a 3 G VT> such that 
V(F(x, k)) — V(x) < —a.3(\x\) everywhere. Then 

V(F p (x,k)) -V(x) < [l-p(k + l)}V(x)+p{k + l)V(F(x,k))-V(x) 

< -p(k + l)V(x)+p(k + l)[V(x)-a 3 (\x\)} = -p(k + l)a 3 (\x\) 

everywhere, so F p again satisfies our PE assumptions. 

A general class of hybrid systems covered by our strictification results is as follows. Assume the continuous 
time system © admits q G V c ts, 7 G /Coo, V G C 1 , and ai,a2 G /Coo satisfying W(x,t) < —q(t)^/(V(x,t)) 
and ai(]a;|) < V(x,t) < a2(|a;|) for all x G M™ and t > (i.e., J5J admits a nonstrict Lyapunov function 
in the sense of JSj)- 1 Given subsets C,D C M. n and p G Vdis taking all its values in {0, 1}, we determine 
conditions on F G USB guaranteeing that we can construct a Lyapunov function for 

n, \ x = G(x.t) , x G C ,„-, 

p - I x k+1 = F p (x k ,k) , x k eD ' (M) 

where F p is as defined above. (The construction we are about to give also works if instead of assuming 
p(k) G {0, 1} for all k G Z> , we assume (i) x i— > V(x, t) is convex for each t G [0, oo) and (ii) p{k) G [0, 1] for 
all k G Z>o- This situation arises if x = G(x,t) :— A(t)x is GAS and A(t) is continuous and bounded since 
then we can take V(x,t) := x T P(t)x for a suitable bounded everywhere positive definite matrix P(t) ^3 
Section 4.6].) To this end, first notice that by reducing 7 G /Coo as necessary, we can assume 7 G C 1 and 
7(s) < ai(a^" 1 (s))/2 for all s > 0. Let F satisfy \F(x,k)\ < a 2 " 1 (ai(|a;|)/2) for all x G D and k G Z> . (This 
reduces to a linear growth condition when V(x 1 t) = x T P(t)x and P has bounded positive eigenvalues.) By 
separately considering the cases p(k + 1) = and p(k + 1) = 1, it follows that 

V(F p (x,k),t) -V(x,t) < p(k + l)a 2 {\F{x,k)\)-p{k + l) ai (\x\) 

< -l p (k + l) ai (\x\) < -p(fc + l) 7 (a 2 (|a;|)) < ~ P (k + l)j(V(x,t)) 

for all x G D, t > 0, and k G Z>o- A slight variant of the proof of Theorem ^] therefore provides an explicit 
globally smooth strict Lyapunov function for Ti p having the form 



VHx,t,k) := 2V(x,t) + - 

T 



q(r) dr ds 



l(V(x,t)) 



4(1 + 1) ^ 

v > s=k-l j=s 



l{V{x,t)) 



for / and r as in the requirements p G Vdis and q G V c ts so 7i p is GAS, as claimed. 

1 A concrete example where this occurs and where it is easy to find V is where q £ Pets (e.g. q(t) = sin 2 (t)) and x = h(x,t) 
is GAS (e.g. x = —x) and we take the dynamic G(x,t) = q(t)h(x,t) and a Lyapunov function V(x,t) for x = h(x,t). 
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7 Conclusions 



We provided new methods for constructing closed form strict Lyapunov functions for hybrid systems that 
admit appropriate nonstrict Lyapunov functions. Our results cover cases where the given nonstrict Lyapunov 
functions satisfy a decay condition involving persistency of excitation parameters or hybrid versions of the 
conditions of Matrosov's Theorem. Due to the ubiquity of Lyapunov functions in engineering applications, 
we expect that our results will be useful in a wide range of settings in which explicit Lyapunov functions are 
needed such as Lyapunov-based controller design and robustness analysis. We conjecture that our results 
can be extended to hybrid control systems with outputs. This would extend |25l I2fi| and the input-to- 
output stability Lyapunov function constructions from |12| to hybrid systems and also provide more explicit 
constructions that would be suited for applications. 



Appendix 

Our proof of Theorem 1141 was based on a continuous time version of Theorem 1101 We next give a precise 
statement and proof of this continuous time result, which is applied in the proof of Theorem 1141 to (x, t) i— * 
Vi(x, t, k) for each k and i = 1, 2. We assume the following version of the Matrosov conditions: 

Assumption A.l There exist V x : W 1 x [0, oo) -» [0, oo) of class UVW and V 2 : R n X [0, oo)^lo/ class 
USB that are C , <fi 2 £ /Coo, nonnegative functions N±, N 2 E USB, a function \ '■ R n x [0, 00) x [0, 00) — > M, 
a positive increasing function <f>\, W E W, and q E "P c ts such that 

VVx{x,t) < -JVi(aj,i), W2OM) < ~N 2 (x,t)+ x (x,N 1 (x,t),t), 
|x(a:,JVi(a:,t),t)| < M\x\)MNi{x, t)), and Nx(x,t) + N 2 (x,t) >q(t)W(x) 
hold for all x E K" and t E [0, 00). 

Notice that V 2 can take both positive and negative values. We show: 

Theorem A. 2 If 0) satisfies Assumvtion \A.l\ then one can construct an explicit strict Lyapunov function 
for pp. In particular, 0) is GAS. 

To prove this theorem, we indicate the changes needed in the proof of Theorem We define V3 and A 
as in Section 15 . 1 . 21 which therefore satisfy 

VV 3 (x,t) < -q(t)W(x)+M\x\)MNi(x,t)) < —q(t)X(Vi(x,t)) + (f>i(\x\)(}) 2 (Ni(x,t)) 

everywhere. We also define fci, Ai, and V4 := ki(Vi)V3 as before and as before also determine positive 
increasing functions T and A2 such that 

VVi{x,t) < [-Wi(a; ) t)]r(Vi(a;,t))-«(t)A 1 (Ki(a; ) t))+A2(^i(x,t))02(JVi(a:,t)). (A.l) 

Choosing k 2 E £«, such that k' 2 > T everywhere gives V{k 2 o Vi) = k'^V^VVx < T(Vi)T>Vi, since VV X < 
everywhere. Enlarging k 2 E /Coo as necessary, it follows that Vg := V4 + k 2 (Vi) E UVW satisfies 

W 5 (x,t) < -q(t)Ai(Vi(x,t)) + A 2 (yi(x,t))<l>2(N 1 (x,t)) . (A.2) 

Applying the continuous time strictification method of |13| and enlarging A2 and reducing Ai as necessary 
without relabeling provides 7 E /Coo and t > such that 



Ve(xA) :=V s {x,t) + 



q(r) dr ds 



l(V 5 (x,t)) (A.3) 



satisfies We(x, t) < —A\(V\{x, t))+A 2 (Vi(x, t))4> 2 {Ni{x, tj). This uses the global boundedness of the double 
integral in l|A.3(l from Lemma0| Arguing as in the proof of Theorem 1101 gives k 3 £ VT> n C 1 such that 

h{r) ~ ^ ( l+£(r) ) 1 + A 2 (r) ' henCe 02 ( fc 3(^i)A 2 (^)) A 2 (^) < A 1 (V 1 ) 
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everywhere. Choose k± G /C^ n C 1 such that k' 4 (s) > \k' 3 (s)\(ctQ o a x 1 )(s) everywhere, where ct\ is as in 
the UPPD requirement on V u and a 6 (\x\) > V 6 (x,t) for all x S K" and t > 0. Then k' A {Vi) > \k 3 (Vi)\V 6 
everywhere, so Vj :— k 3 (Vi)Va + fc 4 (Vi) G UVW everywhere satisfies 

VV 7 < -*3(^i)Ai(Vi) + fc 3 (F 1 )A 2 (t/ 1 )0 2 (iV 1 ) - Velk'^V^VVt + fc^iW 
< -*3(Vi)Ai(Vi) + fc 3 (F 1 )A 2 (^ 1 )0 2 (iV 1 ). 



The rest of the argument is similar to the corresponding part of the proof of Theorem EH with Aj, replaced 

5 

8(7+1) 



by V and s,(i +1 \ replaced by 1. 
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